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Changes  in  the  Standards  for 
Admitting  Expert  Evidence 

Expert  evidence,  which  often  plays  a  critical  role  in  the 
outcome  of  civil  litigation,  has  long  been  a  subject  of 
controversy  in  the  legal  community.  For  many  years, 
judges  relied  largely  on  two  standards  to  determine 
whether  expert  evidence  should  be  admitted  into  a  trial: 
whether  the  evidence  was  relevant  to  the  case  and 
whether  the  evidence  was  generally  accepted  in  the  expert 
community.  But  as  the  importance  of  scientific  evidence 
increased,  observers  began  criticizing  the  relevance  stan¬ 
dard  for  letting  into  evidence  too  much  “junk  science” 
without  a  solid  basis  and  leaving  it  up  to  the  jury  to 
assess  its  scientific  reliability.  Others  argued  that  the  gen¬ 
eral  acceptance  standard  excluded  novel  expert  evidence 
that  was  actually  quite  reliable. 

In  1993,  the  U.S.  Supreme  Court  took  up  this  issue. 

In  Dauber t  v.  Merrell Dow  Pharmaceuticals,  Inc.,  the 
Supreme  Court  directed  federal  judges  to  examine  the 
method  or  reasoning  underlying  the  admission  of  expert 
evidence  and  to  admit  only  evidence  that  was  reliable 
and  relevant.  No  longer  could  judges  defer  to  the  appro¬ 
priate  expert  community  to  determine  whether  the  evi¬ 
dence  was  reliable,  nor  could  they  any  longer  leave  it 
to  the  jury  to  decide.  Judges  now  were  to  act  as  'gate¬ 
keepers,”  screening  expert  evidence  to  ensure  that  what 
was  admitted  was  both  relevant  and  reliable. 

A  new  RAND  report.  Changes  in  the  Standards  for 
Admitting  Expert  Evidence  in  Federal  Civil  Cases  Since  the 


Daubert  Decision  by  Lloyd  Dixon  and  Brian  Gill,  exam¬ 
ines  the  effects  of  this  ruling  on  the  behavior  of  federal 
judges,  plaintiffs,  and  defendants.  By  conducting  a  statis¬ 
tical  analysis  of  data  gathered  from  399  federal  district 
court  opinions  written  between  1980  and  1999,  the 
authors  found  that  judges  have  been  taking  their  new  role 
seriously  and  applying  stricter  standards  to  determine 
what  sort  of  expert  evidence  is  admissible.  They  also 
found  that  plaintiffs  and  defendants  responded  to  the 
change  in  admissibility  standards. 

Judges  Are  Scrutinizing  Reliability  More  Carefully 

The  Daubert  decision  provided  a  list  of  factors  that 
judges  might  take  into  account  when  evaluating  the 
reliability,  or  scientific  validity,  of  evidence: 

•  whether  it  can  be  (and  has  been)  tested 

•  whether  it  has  been  subjected  to  peer  review  and 
publication 

•  its  known  or  potential  rate  of  error 

•  the  existence  and  maintenance  of  standards  controlling 
the  particular  techniques  operation 

•  whether  it  is  generally  accepted  in  the  scientific 
community. 

While  general  acceptance  in  the  scientific  community  is 
still  a  factor,  it  is  only  one  of  many  that  might  enter  the 
judges’  assessment  of  reliability.  The  Supreme  Court 
added  that  judges  are  not  obligated  to  consider  what  have 
come  to  be  called  the  Daubert  factors”  in  every  case,  and 
that  other  factors  may  be  included  in  their  evaluation. 
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Results  of  the  RAND  analysis  show  that  after  the 
Dauhert  decision,  reliability  was  more  carefully  assessed. 
Figure  1  shows  that  judges  addressed  the  issue  of  reliabil¬ 
ity  more  often — and  found  evidence  unreliable  more 
often — after  the  Dauhert  decision  and  up  through  mid- 
1997.  In  subsequent  years,  those  same  proportions  fell. 
The  reversal,  the  authors  argue,  probably  came  about 
because  plaintiffs  and  defendants  began  to  tailor  the  evi¬ 
dence  that  they  proposed. 


NOTE:  Case  type,  substantive  area  of  evidence,  and  appellate  circuit  are  held  constant. 

Figure  1.  Trends  in  Challenges  to  Reliability  of 
Expert  Evidence 


The  RAND  study  found  that  in  the  initial  years  after 
Dauhert,  all  five  Daubert  factors  came  up  more  frequently 
in  judges’  discussions  of  reliability.  Over  time,  judges 
increasingly  mentioned  other  factors  in  their  decisions, 
such  as  the  clarity  and  coherence  of  the  expert’s  explana¬ 
tion  of  the  theory,  methods,  and  procedures  underlying 
the  evidence. 

Because  Dauhert  de-emphasized  the  importance  of  the 
testimony’s  “general  acceptance”  by  the  expert  commu¬ 
nity,  some  legal  observers  initially  expected  the  decision 
to  increase  the  admissibility  of  “novel  science”  that  was 
not  yet  widely  accepted.  The  report’s  authors  did  not 
find  this  to  be  the  case.  They  found  that  lack  of  general 
acceptance  was  as  much  a  barrier  to  admission  after 
Dauhert  as  it  was  before.  What’s  more,  they  found  that 
general  acceptance  was  no  longer  sufficient  for  evidence 
to  be  found  reliable.  After  Dauhert,  judges  began  to 
find  evidence  unreliable  even  though  it  was  generally 
accepted. 
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In  the  early  years  after  Dauhert,  when  there  was  uncer¬ 
tainty  about  whether  the  ruling  applied  to  just  “hard  sci¬ 
ence”  or  all  expert  evidence,  judges  focused  most  of  their 
increased  scrutiny  on  evidence  from  the  physical  sciences. 
However,  they  gradually  began  looking  more  closely  at 
all  types  of  expert  evidence.  These  changes  predated  the 
Supreme  Court’s  1999  decision  in  Kumho  Tire  Co.  v. 
Carmichael,  which  affirmed  that  judges  were  to  assess  the 
reliability  of  all  expert  evidence. 

Judges  were  not  only  more  rigorous  about  assessing  relia¬ 
bility  of  the  evidence  after  Dauhert,  they  were  also  more 
rigorous  about  assessing  relevance  and  expert  qualifica¬ 
tions.  Once  judges  began  acting  as  more  watchful  gate¬ 
keepers,  they  examined  all  dimensions  of  the  evidence 
more  closely. 

Challenges  to  Expert  Evidence  Have  Become 
Increasingly  Fatal  to  Cases 

The  closer  scrutiny  given  expert  evidence  resulted  in  an 
increase  in  the  proportion  of  evidence  that  judges  excluded 
after  Dauhert.  For  example,  as  Figure  2  shows,  the  exclu¬ 
sion  rate  holding  case  type,  area  of  the  evidence,  and 
federal  appellate  circuit  constant  jumped  from  53  percent 
during  the  two  years  before  Dauhert  to  70  percent  between 
mid- 1996  and  mid-1997. 

Moreover,  challenges  to  expert  evidence  are  increasingly 
fatal  to  a  case.  The  table  shows  that,  after  Dauhert,  parties 
challenging  expert  evidence  more  frequently  requested 


NOTE:  Case  type,  substantive  area  of  evidence,  and  appellate  circuit  are  held  constant 


Figure  2.  Trends  in  the  Proportion  of  Challenged  Evidence 
That  Is  Excluded 


summary  judgment  on  some  or  all  of  the  issues  in  a  case, 
and  summary  judgment  was  more  frequently  granted. 
Although  these  increases  may  reflect  other  trends  in  litiga¬ 
tion  practices  that  have  little  to  do  with  Datihert — such  as 
judges’  incentives  to  resolve  cases  more  quickly  and  at 
lower  cost — the  authors  believe  it  is  likely  that  the  more 
rigorous  standards  for  evaluating  expert  evidence  encour¬ 
aged  more  challengers  to  expand  the  scope  of  their  chal¬ 
lenges  and,  in  so  doing,  effectively  undermined  the  entire 
basis  of  the  opposing  party’s  contention. 


Prevalence  of  Summary  Judgments  Before  and 
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Are  These  Trends  Leading  to  More-Accurate 
Evidence  Screening? 

The  data  gathered  for  the  study  did  not  allow  the  authors 
to  examine  how  accurately  judges  are  screening  expert 
evidence.  Judges  may  be  more  actively  evaluating  reliabil¬ 
ity,  but  that  does  not  mean  they  are  making  the  right 
judgments.  They  may  not  be  knowledgeable  enough  in 
the  relevant  field  to  exclude  evidence  that  is  unreliable 
and  avoid  excluding  evidence  that  is  reliable. 

The  authors  suggest  further  analysis  to  explore  these 
questions: 

•  How  well  are  judges  performing  the  gatekeeper 
function?  This  question  could  be  explored  by  conven¬ 
ing  a  panel  of  experts  to  evaluate  how  well  judges  are 
assessing  expert  evidence  in  a  sample  of  cases.  The 
results  could  provide  the  basis  for  a  report  card  on  a 
judge’s  performance. 

•  How  has  Daubert  affected  case  outcomes?  Future 
research  might  examine  how  likely  it  is  for  cases  to  be 
settled  or  dropped  after  expert  evidence  is  excluded. 
Assembling  the  histories  of  a  representative  sample  of 
cases  involving  expert  evidence  would  provide  the  data 
to  answer  this  question. 


The  RAND  Institute  for  Civil  Justice  is  an  inde- 
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